TITLE OF THE INVENTION* 

RECORDING APPARATUS AND METHOD AND STORAGE MEDIUM 

5 FIELD OF THE INVENTION 

The present invention relates to a recording 
apparatus and method and storage medium and, more 
particularly, to a recording apparatus and method for 
attaching meta-data as information related to binary data 
10 to, e. g. , binary data such as still image data, moving image 
data, or voice data obtained using a digital still camera 
or digital video camera. 

BACKGROUND OF THE INVENTION 

15 Along with the spread of digital still cameras or 

digital video cameras, the quantity of binary data such as 
still image data, moving image data, and voice data to be 
processed in general homes is greatly increasing. To use 
the binary data, a certain search method or management 

20 method is required. For this purpose, a method has been 
used in which meta-data as information related to the 
contents, characteristics, and meanings of binary data, 
e.g., a pe^sonV ^s name, event^ titl e^da te, j nd ke ywor d 
describe d in th ^bin ary da taw are atta ch ed to the binary ^data, 

25 and the? binary data i s searched for or managed using this 
attached meta-data . 
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When meta-data representing personal information is 



attached to each binary data, the person who owns the binary 
data can be dis criminate d . Hence, even when a plurality 
of persons share and use one server, the meta-data can be 
5 used for personal management of binary data or privacy 
protection . 

In many cases, however, no meta-data is attached to 
binary data sensed with a d igital still cam era or digital 
video camera, and the meta-data method is not effectively 
10 used. One reason for this is that even when an application 
for processing meta-data is used, generation of meta-data 
and attachment of it to binary data are time-consuming. For 
example, to attach appropriate meta-data to binary data, 
the meta-data must be generated and attached while 
15 confirming the contents of the binary data. Even when the 
same meta-data can be repeatedly used for binary data 
generated under almost the same conditions, the meta-data 
must be repeatedly generated and attached in units of binary 
data . In addition, often no meta-data is attached to binary 
20 data because in loading binary data in a server, generation 
and attachment of meta-data to the binary data are 
time-consuming . 

The present invention has been made to solve the above 
problem, and has as its first object to provide a first 
25 / recording apparatus and method capable of easily generating 
meta-data as information related to binary data such as 
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still image data, moving image data, or voice data, 
generating binary data such as image data and voice data, 
and repeatedly attaching the same meta-data generated to 
a plurality of generated binary data to easily generate 
5 binary data having meta-data. 

It is the second object of the present invention to 
provide a second recording apparatus and method capable of 
easily generating meta-data, using binary data loaded from 
a storage medium or the like, and repeatedly attaching the 

10 same meta-data generated to a plurality of loaded binary 
data to easily generate binary data having meta-data. 

It is the third object of the present invention to 
provide a third recording apparatus and method capable of 
using meta-data loaded from a storage medium o"r the like, 

15 generating binary data, and repeatedly attaching the same 
meta-data loaded to a plurality of generated binary data 
to easily generate binary data having meta-data. The 
present invention also provides a meta-data generation 
apparatus and method for easily generating meta-data and 

20 storing it in a storage medium. 

SUMMARY OF THE INVENTION 
In order to achieve the above object, the first 
recording apparatus of the present invention has the 
25 following feature. There is provided a recording 

apparatus for attaching, to binary data, meta-data as 
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information related to the binary data, comprising 
meta-data generation means for generating the meta-data, 
binary data generation means for generating the binary data 
to which the meta-data is to be attached, and meta-data 
5 attaching means for attaching the same meta-data to a 
plurality of binary data generated by the binary data 
generation means to generate binary data having meta-data. 

In order to achieve the above object, the second 
recording apparatus of the present invention has the 

10 following feature. There is provided a recording 

apparatus for attaching, to binary data, meta-data as 
information related to the binary data, comprising 
meta-data generation means for generating the meta-data, 
binary data loading means for loading the binary data to 

15 which the meta-data is to be attached from a first 

detachable storage medium or external device, and meta-data 
attaching means for attaching the same meta-data to a 
plurality of binary data loaded by the binary data loading 
means to generate .binary data having meta-data. 

20 In order to achieve the above object, the third 

recording apparatus of the present invention has the 
following feature. There is provided a recording 
apparatus for attaching, to binary data, meta-data as 
information related to the binary data, comprising 

25 meta-data loading means for loading the meta-data from a 
first detachable storage medium or external device, binary 
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data loading means for loading the binary data from the 
first detachable storage medium or external device, and 
meta-data attaching means for attaching the same meta-data 
loaded by the meta-data loading means to a plurality of 
5 binary data generated by the binary data generation means 
to generate binary data having meta-data. 

Other features and advantages of the present invention 
will be apparent from the following description taken in 
conjunction with the accompanying drawings, in which like 
10 reference characters designate the same or similar parts 
throughout the figures thereof. 

BRIEF DESCRIPTION OF THE DRAWINGS 
The accompanying drawings, which are incorporated in 
15 and constitute a part of the specification, illustrate 
embodiments of the invention and, together with the 
description, serve to explain the principles of the 
invention . 

Fig. 1 is a block diagram showing a system 
20 configuration of a recording apparatus according to the 
first embodiment; 

Fig. 2A is a view showing the outer appearance of the 
recording apparatus according to the first embodiment; 

Fig. 2B is the rear view of the rear surface of the 
25 recording apparatus according to the first embodiment; 

Fig. 3 is a view showing attachment of a memory card 
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in the first embodiment; 

Fig. A is a view showing a meta-data registration GUI 
window; 

Fig. 5 is a flow chart of meta-data pre-registration; 
5 Fig. 6 is a flow chart of meta-data file generation; 

Fig. 7 is a flow chart of storage of generated 
meta-data in the first embodiment ; 

Fig. 8 is a view showing a meta-data file; 
Fig. 9 is a flow chart showing generation and storage 
10 of image data having meta-data in the first embodiment; 

Fig. 10A shows the file structure of first image data 
having meta-data; 

Fig. 10B shows the file structure of second image 
data having meta-data; 
15 Fig. 11 is a view for explaining the process of 

generating the first image data having meta-data; 

Fig. 12 is' a view for explaining the process of 
generating the second image data having meta-data; 
Fig. 13 is a view showing a meta-data file; 
20 Fig. 14 is a block diagram showing a system 

configuration of a recording apparatus according to the 
second embodiment ; 

Fig. 15A is a view showing the outer appearance of 
the recording apparatus according to the second embodiment; 
25 Fig. 15B is the rear view of the rear surface of the 

recording apparatus according to the second embodiment; 
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Fig. 16 is a view showing attachment of a memory card 
in the second embodiment ; 

Fig. 17 is a flow chart of storage of generated 
meta-data in the second embodiment; 
5 Fig. 18 is a view for explaining the process of 

generating image data having meta-data in the second 
embodiment; 

Fig. 19 is a block diagram showing the system 
configuration of a meta-data generation apparatus 
10 according to the third embodiment ; 

Fig. 20 is a block diagram showing the system 
configuration of a first recording apparatus according to 
the third embodiment; 

Fig. 21 is a block diagram showing the functional 
15 arrangement of the meta-data generation apparatus and first 
recording apparatus according to the third embodiment; 

Fig. 22 shows the structure of image data having 
meta-data, in which meta-data is embedded following image 
data ; 

20 Fig. 23 is a block diagram showing a system 

configuration of a second recording apparatus according to 
the third embodiment; 

Fig. 24 is a block diagram showing the function of 
the meta-data generation apparatus and second recording 
25 apparatus according to the third embodiment; 

Fig. 25 is a view showing attachment of a memory card 
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in the third embodiment; 

Fig. 26 is a view for explaining the process of 
generating image data having meta-data in the third 
embodiment; 

5 Fig. 21 A is a view showing the outer appearance of 

the meta-data generation apparatus according to the third 
embodiment; 

Fig. 27B is the rear view of the rear surface of the 
meta-data generation apparatus according to the third 
10 embodiment; 

Fig. 28A is a view showing the outer appearance of 
the recording apparatus according to the third embodiment; 
and 

Fig. 28B is the rear view of the rear surface of the 
15 recording apparatus according to the third embodiment. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Preferred embodiments of the present invention will 
now be described in detail in accordance with the 
20 accompanying drawings. 

An embodiment of the present invention will be 
described below in detail with reference to the 
accompanying drawings. 

The embodiments will be described below mainly using 
25 still image data as an example of binary data such as still 
image data, moving image data, or voice image data. However, 
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the present invention is not limited to the illustrated 

embodiments . 

[ First Embodiment ] 

As a recording apparatus of the first embodiment, a 
5 recording apparatus 200 capable of generating binary data 
by image sensing or the like, generating meta-data as 
information related to the binary data, and repeatedly 
attaching the same meta-data generated to generated binary 
data to easily generate and output a plurality of binary 
10 data each having meta-data will be described. In the 

following description, still image data is used as binary 
data . 

[Hardware Configuration of Recording Apparatus] 

Fig. 1 is a block diagram showing the system 
15 configuration of the recording apparatus 200. 

A data input/output section 100 inputs/outputs 
binary data or meta-data . As shown in Fig . 3, a memory card 
such as a PC card or PCMCIA card 109 is directly inserted. 
The memory card such as a compact flash 111 or smart medium 
20 113 is inserted via an adapter 110 or card adapter 112. 
Instead of a memory card, other removable storage medium 
(not shown) may be used. 

The data input/output section 100 is connected to an 
external device 107 such as a personal computer via an input 
25 terminal such as a USB terminal, SCSI terminal, or parallel 
terminal. In the following description, a USB terminal is 
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used as an input terminal. 

Data (meta-data or binary data) recorded by the 
external device 107 is directly loaded from the external 
device 107 to the recording apparatus 200 through the input 
5 terminal, or temporarily stored on a memory card 403 and 
then loaded to the recording apparatus 200 through the 
memory card 403. 

Conversely, data processed by the recording 
apparatus 200 is directly written in the external device 

10 107 through the input terminal, or temporarily stored on 
the memory card 403 and then written in the external device 
107 through the memory card 403. The data processed by the 
recording apparatus 200 can be written in a storage section 
102 different from the memory card 403 . The external device 

15 107 and data input/output section 100 can be connected not 
directly as described above but by use of a wireless channel . 
In this case, a wireless channel interface corresponding 
to the external device 107 is exists in the data 
input/output section 100. 

20 An input section 101 inputs data or an instruction 

from the user and is comprised of, e.g., operation buttons 
206 shown in Fig. 2B. The storage section 102 stores binary 
data or meta-data and is formed from, e.g., a hard disk, 
removable medium, or memory card. 

25 A display section 103 displays a GUI or image data 

and is constructed by, e.g., a liquid crystal panel. 
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ACPU 104 controls the entire recording apparatus 200. 
A ROM 105 and RAM 106 provide to the CPU 104 a program, data, 
and work area necessary for processing by the CPU 104. 

Control programs necessary for processing operations 
shown in the flow charts of Figs. 5, 6, 7, and 9 are stored 
in the storage section 102 or ROM 105. When the storage 
section 102 stores a control program, it is temporarily 
loaded to the RAM 106 and then executed. 

A CCD 108 converts an optical image obtained by image 
sensing into an electrical signal, thereby generating image 
data. To convert voice into an electrical signal to 
generate voice data, a microphone (not shown) can be used 
in place of the CCD 108. 

When" a CCD (not shown) for generating moving image 
data is used in place of the CCD 108 for generating still 
image data, a tape or removable medium (not shown) for 
recording the moving image data can be used. Although the 
system configuration includes various components in 
addition to the above components, a detailed description 
thereof will be omitted because they are not main components 
of the present invention. 

Figs . 2A and 2B are views showing the outer 
appearance of the recording apparatus 200. The front 
surface shown in Fig. 2A has an image sensing lens 201, and 
the top surface has an image sensing button 202 as a member 
of the input section 101. The side surface shown in Fig. 2A 



has a memory card slot 203 as a member of the data 
input/output section 100, so data in a storage medium, i.e. , 
memory card 403 inserted into the slot can be loaded into 
the recording apparatus 200 through the memory card 403. 
5 The side surface also has an input terminal (USB terminal 
204 ) as another member of the data input/output section 100, 
which can be connected to an external device 107 and also 
to the memory card 403 inserted into the external device 
107, thereby enabling exchange of meta-data or image data. 

10 The rear surface shown in Fig. 2B has a liquid crystal 

panel 205, so sensed image data can be displayed, or a GUI 
for meta-data attachment can be displayed. 

The rear surface has operation buttons 206 as members 
of the input section 101, which are used for adjustment in 

15 image sensing, or to input meta-data or attach meta-data 
to image data . The operation buttons 206 are used to select , 
change, or add input data, or input new data, as shown in 
Fig. 4. 

In the example shown in Fig. 2A, only the USB terminal 
20 204 is shown as an input terminal. Other input terminal 
such as a parallel terminal or SCSI terminal can be used 
as far as it can transmit /receive data. 

The external device 107 and data input/output section 
100 may be connected not directly as described above but 
25 using a wireless channel. In this case, a wireless channel 
interface corresponding to the external device 107 is 
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included in the data input/output section 100. 
[Input of Meta-Data] 

A series of operations of generating information of 
still image data as meta-data and storing it on the memory 
5 card 403 or the like using the recording apparatus 200 will 
be described, next, in detail. First, an input method for 
registering meta-data will be described with reference to 
Fig. 4. 

Fig. 4 is a view showing a GUI window used to register 

10 meta-data. 

The GUI window has display/input sections 301 to 304 
for displaying meta-data registered in advance or 
displaying newly generated meta-data, buttons 3011, 3021, 
3031, and 3041 used to display lists of registered meta-data , 

15 "add" buttons 305, 307, and 308 for adding information input 
using the operation buttons 206 when no appropriate 
information is present in the displayed list and the user 
wants to add new information, a "change" button 306 for 
changing the date and time of image sensing of still image 

20 data input using the operation buttons 206 and an "OK" 
button 309 for determining meta-data to be registered after 
the end of selection, addition, and change of meta-data to 
be registered. 

A method of registering detailed items "Who?", 

25 "When?", "Where?", and "What?" as meta-data information of 
still image data using the GUI window shown in Fig. 4 will 
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be described next . 

Assume that "Who?" is "Taro", "When?" is "1999-6-14", 
"Where?" is "athletic park", and "What?" is "athletic 
meeting", and these meta-data are selected from lists of 
5 meta-data registered in advance or newly input and 
registered as meta-data. 

"Who?" will be described first. When the button 3011 
having an inverted triangular shape at the right end of the 
[ ~: display/input section 301 is pressed, the first contents 

10 of the list registered for the button 3011 are displayed 
on the display/input section 301. When the button 3011 
having an inverted triangular shape is pressed twice, the 
second contents of the list registered in advance for the 
01 button 3011 are displayed on the display /input section 301. 

Ci 15 Thus, the button 3011 is repeatedly pressed to search for 

CI "Taro" registered in the list in advance. If "Taro" is not 

present in the registered list, "Taro" is input using the 
operation buttons 206, and the "add" button 305 is pressed 
to add "Taro" to the item "Who?". 
20 "When?" will be described next. Upon activating the 

GUI window, the current date and time are displayed on the 
display/input section 302. If the date is different from 
the date of image sensing, the date of image sensing or 
"1999-06-14" is input using the operation buttons 206, and 
25 then the "change" button 306 is pressed to add "1999-06-14" 
to the item "When?". 
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"Where?" will be described next. When the button 
3031 having an inverted triangular shape at the right end 
of the display/input section 303 is pressed, the first 
contents of the list registered for the button 3031 in 
5 advance are displayed on the display/input section 303. 
When the button 3031 having an inverted triangular shape 
is pressed twice, the second contents of the list registered 
in advance for the button 3031 are displayed on the 
display/input section 303. Thus, the button 3031 is 

10 repeatedly pressed to search for "athletic park" registered 
in the list in advance. If "athletic park" is not present 
in the registered list, "athletic park" is input using the 
operation buttons 206, and the "add" button 307 is pressed 
to add "athletic park" to the item "Where?". 

15 "What?" will be described next. When the button 3041 

having an inverted triangular shape at the right end of the 
display/input section 304 is pressed, the first contents 
of the list registered for the button 3041 in advance are 
displayed on the display/input section 304. When the 

20 button 304 1 having an inverted triangular shape is pressed 
twice, the second contents of the list registered in advance 
for the button 3041 are displayed on the display/input 
section 304. Thus, the button 3041 is repeatedly pressed 
to search for "athletic meeting" registered in the list in 

25 advance. If "athletic meeting" is not present in the 
registered list, "athletic meeting" is input using the 
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operation buttons 206, and the "add" button 308 is pressed 
to add "athletic meeting" to the item "What?". 

After all the items "Who?", "When?", "Where?", and 
"What?" are input, the "OK" button 309 is pressed to 
5 register the set items, thereby ending meta-data 
registration . 

As meta-data registration, only the method of 
displaying, selecting, and inputting the items "Who?", 
"When?", "Where?", and "What?" has been described above. 
10 A method of displaying, selecting, and inputting another 
item on the window can be added. 
[Generation and Storage of Meta-Data] 

A series of operations f orgenera ting meta-data and 
storing it on the memory card 403 or in the storage section 
15 102 using the recording apparatus 200 will be described next 
in detail with reference to Figs. 5 to 8 . 

Fig. 5 is a flow chart showing processing of 
generating meta-data and storing the generated meta-data 
on the memory card 403 or in the storage section 102 by the 
20 recording apparatus 200. 

First, in step S401, list files "Who?", "When?", 
"Where?", and "What?" which are to be registered for the 
buttons 3011, 3021, 3031, and 3041 and displayed on the 
display/input sections 301 to 304 are loaded to the RAM 106. 
25 In step S402, the loaded lists are displayed on the 

GUI window shown in Fig. 4. 
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In step S403, the user inputs meta-data "Who?", 
"When?", "Where?", and "What?" to the display/input 
sections 301 to 304, respectively. The input method has 
already been described above in detail with reference to 
Fig. 4, thus, the detailed description thereof will be 
omitted . 

In step S404, when the "OK" button 309 shown in Fig. 4 
is pressed, a meta-data file is. generated on the basis of 
the input meta-data using a data description language, i.e., 
a markup language such as the XML shown in Fig. 8. 

In the example shown in Fig. 8, the input meta-data 
are registered as a meta-data file with a file name: 
"Cardlnf o. xml" . To describe the meta-data, a markup 
language XML is used. Instead of the XML, the SGML or HTML 
can be used. 

In step S405, the generated meta-data file is written 
on the memory card 403 or in the storage section 102 through 
the data input/output section 100 and stored with the file 
name : "Cardlnf o . xml" . Write processing on the memory card 
403 or in the storage section 102 will be described later 
in detail with reference to Fig. 7, thus the detailed 
description thereof will be omitted at this time. 

In the above-described example, one meta-data file 
is generated. However, a plurality of meta-data files may 
be generated. In this case, a meta-data file can be 
repeatedly generated to generate a plurality of meta-data 



files. 

[Generation of Meta-Data File] 

Fig. 6 is a flow chart showing meta-data file 
generation executed by the recording apparatus 200 in step 
5 S404 on the basis of the input value of meta-data input by 
the user in step S403. 

First, instepSSOl, it is checked whether the button 
3011, 3021, 3031, or 3041 is pressed. If NO in step S501, 
processing waits until input is detected. If YES in step 
10 S501, the flow advances to step S502. When any one of the 
buttons 305 to 308 is pressed, the flow advances to step 
S503. When the button 309 is pressed, the flow advances 
to step S504. 

When step S502 is selected, the contents of a list 
15 corresponding to one of the list display buttons 3011, 3021, 
3031, and 3041 are displayed, and the flow advances to step 
S505. When the list file displayed in correspondence with 
one of the list display buttons 3011, 3021, 3031, and 3041 
is selected, the flow advances to step S506. After the 
20 selected item is copied to the input area, the flow returns 
to step S501. When the displayed list file is not selected 
in step S505, the flow returns to step S501 without any 
processing . 

When step S503 is selected, it is checked whether the 
25 "add" button 305, 307, or 308 is pressed or whether the 
"change" button 306 is pressed. When the "add" button 305, 
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307, or 308 is pressed, the flow advances to step S507. 
After the contents of the display/input section, which are 
added by the user, are added to a corresponding list file, 
the fl ow advances to step S508. When the "change" button 
5 306 is pressed, the flow advances to step S508 without 
meaning processing step 7. In step S508, the date and time 
in the list file are changed to the contents on the 
display/input section, and the flow returns to step S501. 
^: When step S504 is selected, and the "OK" button is 

I*; 10 pressed, a meta-data file is generated, and the series of 

i sjs operations are ended. 

! «U Thus, the meta-data file shown in Fig. 8 is 

\ i I 

•3- - 

* generated. 

3l In the above-described example, the user inputs 

rj 15 meta-data using the operation buttons 206. As another 

£j input method, meta-data can be inputed from a remote 

controller using a G code or inputed by using voice 
recognition. Alternatively, the recording apparatus 200 
can be connected to the external device 107 through the 
20 input terminal of the data input/output section 100, and 
meta-data can be input using the input section such as a 
keyboard of the external device 107. 

Fig. 8 will be described. To describe meta-data, 
XML is used. XML (extensible Markup Language) is a markup 
25 language used by applications that require functions beyond 
the current HTML (HyperText Markup Language) . XML 
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developed by the World Wide Web consortium mainly has the 
following characteristic features. 

1. An information provider can freely define new tags 
and attribute names . 
5 2. A document can have any complex nested structure. 
3. A description of syntax can be optionally embedded 
in an XML document, and an application can be made to verify 
the validity of structure using this syntax. 

The description by XML shown in Fig. 8 can be written 

10 using a general-purpose text editor program. However, to 
generate a so-called "wellformed XML" in which, e.g., 
<PHOTO> and </PHOTO> or <ITEM> and </ITEM> correctly 
correspond, an XML editor program can be conveniently used. 
[Write of Meta-Data in Storage Section or on Memory Card"] 

15 Fig. 7 is a flow chart showing processing of writing 

the meta-data shown in Fig. 8 in the storage section 102 
or on the memory card 403, which is executed in step S405 
shown in Fig. 5. 

First, in step S601, to execute write processing on 

20 the memory card 403, the memory card 403 such as a PC card 
is inserted into the data input/output section 100. 
Alternatively, the recording apparatus 200 may be connected 
to the external device 107 through the input terminal of 
the data input/output section 100. 

25 After completion of connection, in step S602, the 

meta-data generated in step S404 are written in the storage 
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section 102 or on the memory card 403, and processing is 



[Processing of Linking Meta-Data to A Plurality of Binary 
Data] 



generated meta-data to binary data will be described next 
with reference to Figs. 9 to 12. In the following 
description, still image data is used as binary data. 

As the method of linking meta-data to binary data, 
10 1) the first process of embedding the entire meta-data in 
still image data (Fig. 10A) and 2) the second process of 
attaching only meta-data linking information, for example 
file name, to still image data (Fig. 10B) will be described 
as examples. 

15 Fig. 10A shows a data structure in which meta-data 

generated by the recording apparatus 200 are embedded in 
and linked to image data. In the example shown in Fig. 10A, 
the generated meta-data are embedded in the image data file. 
The meta-data embedding position is not limited to that 

20 shown in Fig. 10A. The meta-data' may be embedded in the 
header section of the image data. 

Referring to Fig. 10A, reference numeral 901 denotes 
image data having, e.g., a JPEG compression format; 902, 
a meta-data header; 903, a meta-data body; and 904, a 

25 meta-data footer. The identification information and size 
of the meta-data are recorded in each of the meta-data 



ended . 



5 



Two processes of linking the above-described 
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header 902 and meta-data footer 904 to accurately recognize 
whether the meta-data is concatenated to the image data. 
The "Cardlnfo.xml" shown in Fig. 8 is recorded in the 
meta-data body 903. 
5 When meta-data described as XML data is connected to 

the end of binary data, the meta-data can be registered 
without influencing other applications. More 
specifically, the information in the header section of 
binary data does not change from the state before connection 
10 of meta-data. For this reason, if the binary data is, e.g., 
image data, the image can be reproduced by a general browser . 
In this case, however, the connected meta-data is 
neglected . 

Since the meta-data is described in the XML, many 
15 apparatuses capable of reading the XML format can read the 
information of meta-data, and the meta-data can be added, 
changed, or referred to using a tool for understanding the 
XML data, so it is excellent in versatility. As described 
above, when information that is known about image data is 
20 prepared as a meta-data template in advance, and meta-data 
is repeatedly attached to image data in image sensing, the 
time required to attach meta-data to the image data can be 
shortened . 

Fig. 10B is shows a data structure after the 
25 information of meta-data generated by the recording 
apparatus 200 is attached to image data to link the 
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meta-data to the image data. In the example shown in 
Fig. 10B, only the meta-data file name is attached to the 
end of image data as the information of generated meta-data, 
and the meta-data file is independently present. The 
5 meta-data attachment position is not limited to that shown 
in Fig. 10B. The meta-data may be attached to the header 
section of the image data . In the example shown in Fig. 10B, 
the file name of generated meta-data is attached to the end 
of image data. However, information representing the 

10 location of meta-data file may be attached. 

To record meta-data in image data, a standard called 
URL (Uniform Resource Locator) for specifying the physical 
location of data on the web or URN (Uniform Resource Name) 
for designating data using a unique name, or URI (Uniform 

15 Resource Identifier) as a standard currently under 

examination, inclusive of both the URL and URN, can be used. 
If the URI iswidely used in the future, this can be optimally 
used to specify data on, e.g., the web. When JPEG is used 
to compress image data, an APP marker defined by the JPEG 

20 standard may be used to record meta-data. 

Since the URI for specifying meta-data is recorded 
in image data, the image data and meta-data can be easily 
independently processed. Especially, the present 
invention can be widely used to, e.g., store meta-data on 

25 a network and read it using the URI. Additionally, when 
the URI of meta-data and that of image data have a 
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predetermined association, the correspondence between the 
image data and the meta-data can be easily grasped. For 
example, the correspondence can be recognized by referring 
to the file name. The present invention can save memory 
5 capacity of storage media to avoid copying and string the 
same meta-data repeatedly. 

A method of repeatedly linking the same meta-data 
generated by the recording apparatus 200 to a plurality of 
image data input or generated by image sensing to generate 

10 image data having meta-data will be described next with 
reference to Figs. 11 and 12. 

Fig. 11 is a schematic view showing an example in 
which the entire meta-data (file name: Cardlnf o . xml ) is 
repeatedly copied and embedded in a plurality of still image 

15 data (file name: AUT__001.jpg, AUT_002.jpg, 

AUT_003.jpg,...) input or generated by image sensing. 

When image data (file name: AUT_001.jpg) and 
meta-data file (file name: Cardlnf o . xml ) which are 
independently present, as shown by (before linking) in 

20 Fig. 11, are linked to each other by the recording apparatus 
200, the entire information of the meta-data is copied and 
embedded at the end of the image data" (file name: 
AUT_001.jpg), as shown by (after linking) in Fig. 11. 

When the meta-data file (file name: Cardlnf o . xml ) is 

25 linked to the second image data (file name: AUT_002.jpg) 
by the recording apparatus 200 in the same manner as 
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described above, the entire information of the meta-data 
is copied and embedded at the end of the image data (file 
name: AUT_002.jpg) . Thus, the same meta-data generated by 
the recording apparatus 200 is repeatedly linked to a 
5 plurality of image data. 

Fig. 12 is a schematic view showing an example in 
which only the meta-data information (file name: 
Cardlnf o . xml) is repeatedly attached to a plurality of 
!"( still image data (file name: AUT_001.jpg, AUT_002.jpg, 

10 AUT_003.jpg,...) input or generated by image sensing. 

When image data (file name: AUT_001.jpg) and 
f{ meta-data file (file name: Cardlnf o . xml ) which are 

independently present, as shown by (before linking) in 
81 Fig. 12, are linked to each other by the recording apparatus 

Ci 15 200, information representing the meta-data file name 

.» 

C! (Cardlnfo. xml) is attached to the end of the image data, 

as shown by (after linking) in Fig. 12, so the image data 
is linked to the meta-data file (Cardlnf o . xml ) that is 
actually present. 

20 When the meta-data file (file name: Cardlnf o . xml ) is 

linked to the second image data (file name: AUT_002.jpg) 
by the recording apparatus 200 in the same manner as 
described above, information representing the meta-data 
file name (Cardlnf o . xml ) is attached to the end of the image 

25 data (file name: AUT_002.jpg), as shown by (after linking) 
in Fig. 12, Thus, the same meta-data generated by the 
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recording apparatus 200 is repeatedly linked to a plurality 
of image data (file name: AUT__001.jpg, AUT_002.jpg, 
AUT_003. jpg, . . . . ) 

In the example shown in Fig. 12, linking processing 
5 of attaching only the file name of meta-data is performed, 
instead of embedding the meta-data itself in the image data . 
In place of the meta-data file name, information 
representing the storage location where the meta-data file 
is stored can be attached to the image data. 

10 [Generation of Image Data Having Meta-Data] 

Processing of linking meta-data to image data to 
generate image data having meta-data, as described with 
reference to Fig. 11 or 12, and storing the generated image 
data having meta-data, which is performed by the recording 

15 apparatus 200, will be described next with reference to the 
flow chart shown in Fig. 9. In the example to be described 
below, the same meta-data is repeatedly attached to each 
image sensed and converted into image data. 

Instead of using the method to be described below, 

20 for example, a plurality of meta-data capable of explaining 
a plurality of image data to be sensed can be prepared in 
advance in correspondence with the plurality of image data, 
and the different meta-data can be selected and repeatedly 
attached to the sensed image data, respectively. First, 

25 in step S800, the above-described meta-data (Cardlnf o . xml ) 
stored in the storage section 102 is loaded to the RAM 106. 
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Alternatively, the above-described meta-data 
(Cardlnfo. xml) stored on the memory card 403 is loaded to 
the RAM 106 from the memory card 403 directly connected to 
the memory card slot 203 of the data input/output section 
5 100. In the above example, one meta-data stored in the 
storage section 102 or on the memory card 403 is read out 
and used. However, a plurality of stored meta-data may be 
read out and used. 

In step S801, it is checked whether the loaded 
10 meta-data is described by an appropriate XML format. If 
NO in step S801, the flow advances to step S806 to display 
an XML error, and the operation is ended. If YES in step 
S801, the flow advances to step S802. 

In step S802, image data sensed through the CCD 108 
15 is loaded to the RAM 106. 

In step S803, the meta-data is linked to the image 
data to generate image data having meta-data. More 
specifically, when an instruction for linking the meta-data 
to the image data is issued (a process selected from the 
20 two processes described above) , the meta-data is attached 
to the image data to generate image data having meta-data. 
For example, image data having meta-data shown in Fig. 10A 
or 10B is generated. 

In step S804, the generated image data having 
25 meta-data is stored on the memory card 403 or in the storage 
section 102 . This image data having meta-data may be stored 
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both on the memory card 403 and in the storage section 102. 

In step S805, if the user wants to continue image 
sensing, the flow returns to step S802 to continuously 
perform the above-described processing, thereby generating 
5 new image data having meta-data shown in Fig. 11 or 12 . For 
example, in the case shown in Fig. 11, the same meta-data 
is repeatedly attached to a plurality of image data to 
obtain image data having meta-data (filename: AUT_002.jpg, 
AUT_003.jpg,....) When the user ends image sensing, the 

10 series of operations are ended. 

As described above, only by generating meta-data once, 
in advance, the meta-data can be repeatedly attached to 
image data obtained by image sensing to generate image data 
having meta-data. For this reason, operation of 

15 generating the image data having meta-data is facilitated. 
The generated meta-data can also be repeatedly attached to 
a plurality of different image data not obtained by image 
sensing but input from the memory card 403 to generate image 
data having meta-data. 

20 A plurality of meta-data may be generated in advance 

and selected as needed such that meta-data of different 
types are attached to a plurality of image data. In this 
embodiment, still image data is used as binary data. 
Instead, voice data or moving image data may be used as 

25 binary data. 

In step S804, the image data having meta-data is 
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stored in, e.g., the storage section 102 or on the memory 
card 403 inserted into the data input/output section 100. 
However, the image data having meta-data may be stored on 
the memory card 403 as a first storage medium which had 
stored the original image data before meta-data attachment 
or another memory card as a second storage medium. 

The image data having meta-data may be directly 
written in the external device 107 through the input 
terminal of the recording apparatus 200 or temporarily 
stored on the memory card 403 or in the storage section 102 
and then written in the external device 107 through the 
memory card 403 or storage section 102. 

The external device 107 and data input/output section 
100 can be connected not directly as described above but 
by using a wireless channel. In this case, a wireless 
channel interface corresponding to the external device 107 
is incorporated in the data input/output section 100. 

The meta-data may be generated in advance, as 
described above, or meta-data prepared on a memory card in 
advance may be used . Fig. 13 is a view showing this example . 
In this example, for example, a memory card for travel is 
put on sale, and meta-data for travel which is stored on 
the memory card, in advance, is used. A memory card in which 
meta-data for moving' images, meta-data for voice data, and 
meta-data for still images are prepared in advance in 
correspondence with binary data may be used. 



[ Second Embodiment ] 

As a recording apparatus of the second embodiment, 
a recording apparatus 2200 (Fig. 14) capable of loading 
binary data stored in a storage medium or the like, 
5 generating meta-data as information related to the binary 
data, and linking the generated meta-data to a plurality 
of loaded binary data to generate and output binary data 
each having meta-data will be described. In the following 
description, still image data is used as binary data. 

10 [Hardware Configuration of Recording Apparatus] 

Fig. 14 is a block diagram showing the system 
configuration of the recording apparatus 2200. 

A data input/output section 2100 inputs/outputs 
binary data or meta-data. As shown in Fig. 16, a memory 

15 card such as a PC card or PCMCIA card 109 is directly inserted. 
As shown in Fig. 16, a memory card such as a compact flash 
111 or smart medium 113 is inserted via an adapter 110 or 
card adapter 112. Instead of a memory card, a removable 
strage medium (not shown) may be used. 

20 The data input/output section 2100 is connected to 

an external device 2107 such as a digital camera via an input 
terminal such as a USB terminal, SCSI terminal, or parallel 
terminal. In the following description, a USB terminal is 
used as an input terminal. 

25 Data (meta-data or binary data) recorded by the 

external device 2107 is directly loaded from the external 
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device 2107 to the recording apparatus 2200 through an input 
terminal, or temporarily stored on a memory card 403 and 
then loaded to the recording apparatus 2200 through the 
memory card 4 03. 
5 Conversely, data processed by the recording 

apparatus 2200 is directly written in the external device 
2107 through an output terminal, or temporarily stored on 
the memory card 403 and then written in the external device 
2107 through the memory card 403. The data processed by 

10 the recording apparatus 2200 is written in a storage section 
2102. The external device 2107 and data input/output 
section 2100 can be connected not directly as described 
above but by using a wireless channel. In this case, a 
wireless channel interface corresponding to the external 

15 device 2107 is incorporated in the data input/output 
section 2100. 

An input section 2101 inputs data or instructions 
from the user and is formed from, e.g., a keyboard, mouse, 
remote controller, and the like. The storage section 2102 

20 stores binary data or meta-data and is formed from, e.g., 
a hard disk. 

A display section 2103 displays a GUI or image data 
and is constructed by, e.g., a CRT or liquid crystal 
display . 

25 A CPU 2104 controls the entire recording apparatus 

2200. A ROM 2105 and RAM 2106 provide to the CPU 2104 a 
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program, data, and work area necessary for processing by 
the CPU 2104. 

Control programs necessary for processing operations 
shown in the flow charts of Figs. 5, 6, 17, and 18 are stored 
5 in the storage section 2102 or ROM 2105. When the storage 
section 2102 stores a control program, it is temporarily 
loaded to the RAM 2106 and then executed. 

Although the system configuration includes various 
components in addition to the above components, a detailed 
10 description thereof will be omitted because they are not 
main components of the present invention. 

Figs. ISA and 15B are views showing the outer 
appearance of the recording apparatus 2200. The front 
surface shown in Fig. ISA has a slot as one member of the 
15 data input/output section 2100, so data can be loaded into 
the recording apparatus 2200 through the memory card 403 
inserted into the slot. 

A power switch 2202 powers on/off the recording 
apparatus 2200. An infrared light-receiving section 2203 
20 receives a signal from a wireless keyboard 2204 or remote 
controller 2205. The wireless keyboard 2204 and remote 
controller 2205 are used as members of the input section 
2101 . 

The rear view shown in Fig. 15B has a display output 
25 terminal 2206 to which the display section 2103 such as a 
CRT or liquid crystal display is connected. To directly 
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connect the recording apparatus to the external device 2107 
such as a digital camera, a USB terminal 2307 as an input 
terminal or a member of the data input/output section 2100 
is used. An input terminal such as a SCSI terminal (not 
5 shown) or parallel terminal (not shown) may be available 
at an arbitrary position on the front or rear surface of 
the recording apparatus 2200. 
[Input of Meta-Data] 

A series of operations of generating information of 
10 still image data as meta-data and storing it on the memory 
card 403 or the like using the recording apparatus 2200 will 
be described next in detail. First, an input method of 
registering meta-data will be described with reference to 
Fig. 4. 

15 Fig. 4 is a view showing a GUI window used to register 

meta-data . 

The GUI window has display/input sections 301 to 304 
for displaying meta-data registered in advance or 
displaying newly generated meta-data, buttons 3011, 3021, 

20 3031, and 3041 used to display lists of registered meta-data, 
"add" buttons 305, 307, and 308 for adding information input 
using the wireless keyboard 2204 or remote controller when 
no appropriate information is present in the displayed list 
and the user wants to add new information, a "change" button 

25 306 for changing the date and time of image sensing of still 
image data input using the wireless keyboard 2204 and an 
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"OK" button 309 for determining meta-data to be registered 
after the end of selection, addition, and change of 
meta-data to be registered. 

A method of registering detailed items "Who?", 
5 "When?", "Where?", and "What?" as meta-data information of 
still image data using the GUI window shown in Fig. 4 will 
be described next. 

Assume that "Who?" is "Taro", "When?" is "1999-6-14", 
"Where?" is "athletic park", and "What?" is "athletic 
yi 10 meeting", and these meta-data are selected from lists or 

hi newly input and registered as meta-data. 

jjj "Who?" will be described first. When the button 3011 

having an inverted triangular shape at the right end of the 
IVs " display/input section 301 is pressed, the first contents* 

]z[ 15 of the list registered for the button 3011 are displayed 

u on the display/input section 301. When the button 3011 

having an inverted triangular shape is pressed twice, the 
second contents of the list registered in advance for the 
button 3011 are displayed on the display/input section 301. 
20 Thus, the button 3011 is repeatedly pressed to search for 
"Taro" registered in the list in advance. If "Taro" is not 
present in the registered list, "Taro" is input using the 
wireless keyboard 2204, and the "add" button 305 is pressed 
to add "Taro" to the item "Who?". 
25 "When?" will be described next. Upon activating the 

GUI window, the current date and time are displayed on the 
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display/input section 302. If the date is different from 
the date of image sensing, the date of image sensing or 
"1999-06-14" is input using the wireless keyboard 2204, and 
then the "change" button 306 is pressed to add "1999-06-14" 
5 to the item "When?". 

"Where?" will be described next. When the button 
3031 having an inverted triangular shape at the right end 
of the display/input section 303 is pressed, the first 
contents of the list registered for the button 3031 in 

10 advance are displayed on the display/input section 303. 
When the button 3031 having an inverted triangular shape 
is pressed twice, the second contents of the list registered 
in advance for the button 3031 are displayed on the 
display/input section 303. Thus, the button 3031 is 

15 repeatedly pressed to search for "athletic park" registered 
in the list in advance. If "athletic park" is not present 
in the registered list, "athletic park" is input using the 
wireless keyboard 2204, and the "add" button 307 is pressed 
to add "athletic park" to the item "Where?". 

20 "What?" will be described next. When the button 3041 

having an inverted triangular shape at the right end of the 
display/input section 304 is pressed, the first contents 
of the list registered for the button 3041 in advance are 
displayed on the display /input section 304. When the 

25 button 3041 having an inverted triangular shape is pressed 
twice, the second contents of the list registered in advance 
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for the button 3041 are displayed on the display/input 
section 304. Thus, the button 3041 is repeatedly pressed 
to search for "athletic meeting" registered in the list in 
advance. If "athletic meeting" is not present in the 
5 registered list, "athletic meeting" is input using the 
wireless keyboard 2204, and the "add" button 308 is pressed 
to add "athletic meeting" to the item "What?". 

After all the items "Who?", "When?", "Where?", and 
"What?" are input, the "OK" button 309 is pressed to 
10 determine the set items, thereby ending meta-data 
registration . 

As meta-data registration, only the method of 
displaying, selecting, and inputting the items "Who?", 
"When?", "Where?", and "What?" has been described above. 
15 A method of displaying, selecting, and inputting another 
item on the window can be added. 
[Generation and Storage of Meta-Data] 

A series of operations of generating meta-data and 
storing it on the memory card 403 or in the storage section 
20 2102 using the recording apparatus 2200 will be described 
next in detail with reference to Figs. 5, 6, 17, and 8. 

Fig. 5 is a flow chart showing processing of 
generating meta-data and storing the generated meta-data 
on the memory card 403 by the recording apparatus 2200. 
25 First, in step S401, list files "Who?", "When?", 

"Where?", and "What?" which are to be registered for the 
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buttons 3011, 3021, 3031, and 3041 and displayed on the 
display/input sections 301 to 304 are loaded to the RAM 
2106. 

In step S402, the loaded lists are displayed on the 
5 GUI window shown in Fig. 4. 

In step S403, the user inputs meta-data "Who?", 
"When?", "Where?", and "What?" to the display/input 
sections 301 to 304, respectively. The input method has 
already been described above in detail with reference to 
10 Fig. 4, and a detailed description thereof will be omitted. 

In step S404, when the "OK" button 309 shown in Fig. 4 
is pressed, a meta-data file is generated on the basis of 
the input meta-data using a data description language, i.e., 
a markup language such as the XML shown in Fig. 8. 
15 In the example shown in Fig. 8, the input meta-data 

are registered as a meta-data file with a file name: 
"Cardlnf o . xml" . To describe the meta-data, a markup 
language XML is used. Instead of the XML, the SGML or HTML 
can be used. 

20 In step S405, the generated meta-data file is written 

on the memory card 403 through the data input/output section 
2100 and stored with the file name: "Cardlnf o . xml" . Write 
processing on the memory card 403 or in the storage section 
2102 will be described later in detail with reference to 

25 Fig. 17, and a detailed description thereof will be omitted . 
The generated meta-data file is also stored in the storage 
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section 2102 of the recording apparatus 2200, as needed. 

In the above-described example, one meta-data file 
is generated. However, a plurality of meta-data files may 
be generated. In this case, a meta-data file can be 
5 repeatedly generated to generate a plurality of meta-data 
files . 

[Generation of Meta-Data File] 

Fig. 6 is a flow chart showing meta-data file 
generation executed by the recording apparatus 2200 in step 

10 S404 on the basis of the input value of meta-data input by 
the user in step S403. 

First, in step S501, it is checked whether the button 
3011, 3021, 3031, or 3041 is pressed. If NO in step S501, 
processing waits' until input is detected. If YES in step 

15 S501, the flow advances to step S502. When any one of the 
buttons 305 to 308 is pressed, the flow advances to step 
S503. When the button 309 is pressed, the flow advances 
to step S504 . 

When step S502 is selected, the contents of a list 

20 corresponding to one of the list display buttons 3011, 3021, 
3031, and 3041 are displayed, and the flow advances to step 
S505. When the list file displayed in correspondence with 
one of the list display buttons 3011, 3021, 3031, and 3041 
is selected, the flow advances to step S506. After the 

25 selected item is copied to the input area, the flow returns 
to step S501. When the displayed list file is not selected 
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in step S505, the flow returns to step S501 without any 
processing . 

When step S503 is selected, it is checked whether the 
"add" button 305, 307, or 308 is pressed or whether the 
5 "change" button 306 is pressed. When the "add" button 305, 
307, or 308 is pressed, the flow advances to step S507. 
After the contents of the display/input section, which are 
added by the user using the keyboard, are added to a 
corresponding list file, the flow advances to step S508. 
10 When the "change" button 306 is pressed, the flow advances 
to step S508 without any processing. In step S508, the date 
and time in the list file are changed to the contents on 
the display/input section, and the flow returns to step 
" S501. 

15 When step S504 is selected, and the "OK" button is 

pressed, a meta-data file is generated, and the series of 
operations are ended. 

Thus, the meta-data file shown in Fig. 8 is 
generated . 

20 In the above-described example, the user inputs 

meta-data using the wireless keyboard 2204. As another 
input method, an arbitrary input method such as voice input 
from a remote controller using a G code, input using voice 
recognition, or input from an external device through a 

25 network can be used. 

Fig. 8 will be described. To describe meta-data , the 
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XML is used. The XML (extensible Markup Language) is a 
markup language used by applications that require functions 
beyond the current HTML (HyperText Markup Language) . The 
XML developed by the World Wide Web consortium mainly has 
5 the following characteristic features. 

1. An information provider can freely define new tags 
and attribute names. 

2. A document can have any complex nested structure. 

3. A description of syntax can be optionally embedded 
10 in an XML document, and an application can be made to verify 

the validity of structure using this syntax. 

The description by the XML shown in Fig. 8 can be 

written using a general-purpose text editor program. 

However, to generate a so-called "wellf ormed XML" in'which, 
15 e.g., <PHOTO> and </PHOTO> or <ITEM> and </ITEM> correctly 

correspond, an XML editor program can be conveniently used. 

[Write of Meta-Data on Memory Card] 

Fig. 17 is a flow chart showing processing of writing 

the meta-data shown in Fig. 8 in the storage section 2102 
20 or on the memory card 403, which is executed in step S405 

shown in Fig. 5. 

First, in step S601, to execute write processing on 

the memory card 403, the memory card 403 such as a PC card 

is inserted into the data input/output section 2100. 
25 Alternatively, the recording apparatus 2200 may be 

connected to the memory card 403 inserted into the external 
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device 2107 through the input terminal of the data 
input/output section 2100. 

After completion of connection, in step S602, the 
meta-data generated in step S404 is written on the memory 
5 card 403. 

In step S603, if the apparatus has an ejection 
function for the memory card 403, the memory card 403 is 
ejected, and processing is ended. 

In the above-described example, to write meta-data 
10 on the memory card 403, the meta-data is written on the 
memory card 403 which is directly inserted and connected 
to the data input/output section 2100, or the meta-data is 
written, through the input terminal, on the memory card 403 
inserted into the external device 2107. Any other 
15 connection method such as wireless connection as described 
above can be used as long as the memory card 4 03 is accessible . 
The meta-data can also be written in the storage section 
2102. 

[Meta-Data Linking Processing to A Plurality of Binary 
20 Data] 

Two processes of linking the above-described 
generated meta-data to binary data will be described next 
with reference to Fig. 18 and Figs. 10 to 12. In the 
following description, still image data is used as binary 
25 data. 

As the method of linking meta-data to binary data, 
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1) the first process of embedding all the meta-data in still 
image data (Fig. 10A) and 2) the second process of attaching 
only meta-data information to still image data (Fig. 10B) 
will be described as examples. 
5 Fig. 10A is a schematic view showing a data structure 

in which meta-data generated by the recording apparatus 
2200 are embedded in and linked to image data. In the 
example shown in Fig. 10A, the generated meta-data are 
embedded following the image data. The meta-data 
10 embedding position is not limited to that shown in Fig. 10A. 
The meta-data may be embedded in the header section of the 
image data. 

Referring to Fig. 10A, reference numeral 901 denotes 
image data having, e.g., a JPEG compression format"; 902, 

15 a meta-data header; 903, a meta-data body; and 904, a 

meta-data footer. The identification information and size 
of the meta-data are recorded in each of the meta-data 
header 902 and meta-data footer 904 to accurately recognize 
whether the meta-data is linked to the image data. The 

20 "Cardlnfo.xml" shown in Fig. 8 is recorded in the meta-data 
body 903. 

When meta-data described as XML data is connected to 
the end of binary data, the meta-data can be registered 
without influencing other applications. More 
25 specifically, the information in the header section of 
binary data does not change from the state before connection 
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of met a -data . For this reason, if the binary data is , e.g., 
image data, the image can be reproduced by a general browser. 
In this case, however, the connected meta-data is 
neglected. 

5 Since the meta-data is described in the XML, many 

apparatuses capable of reading the XML format can read the 
information of meta-data, and the meta-data can be added, 
changed, or referred to using a tool for understanding the 
XML data, so it is r excellent in versatility. As described 

10 above, when information that is known about image data is 
prepared as a meta-data template in advance, and meta-data 
is repeatedly attached to image data , the time required 
to attach meta-data to the image data can be shortened. 

Fig. 10B is a schematic view showing a data structure 

15 after the information of meta-data generated by the 

recording apparatus 2200 is attached to image data to link 
the meta-data to the image data. In the example shown in 
Fig. 10B, only the meta-data file name (Cardlnf o . xml ) is 
attached to the end of image data as the information of 

20 generated meta-data, and the meta-data file is 

independently present. The meta-data attachment position- 
is not limited to that shown in Fig. 10B. The meta-data 
may be attached to the header section of the image data. 
In the example shown in Fig. 10B, the file name of generated 

25 meta-data is attached to the end of image data. However, 
information representing the location of meta-data file may 
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be attached. 

To record meta-data in image data, a standard called 
URL (Uniform Resource Locator) for specifying the physical 
location of data on the web or URN (Uniform Resource Name) 
5 for designating data using a unique name, or URI (Uniform 
Resource Identifier) as a standard currently under 
examination, inclusive of both the URL and URN, can be used. 
If the URI will be widely used in the future, this can be 
optimally used to specif y data on, e.g., the web. When JPEG 

10 is used to compress image data, an APP marker defined by 
the JPEG standard may be used to record meta-data. 

Since the URI for specifying meta-data is recorded 
in image data, the image data and meta-data can be easily 
independently processed. Especially, the present 

15 invention can be widely used to, e.g., store meta-data on 
a network and read it using the URI. Additionally, when 
the URI of meta-data and that of image data have a 
predetermined association, the correspondence between the 
image data and the meta-data can be easily grasped. For 

20 example, the correspondence can be recognized by referring 
to the file name. The present invension can save memory 
capacity of strage media to avoid copying and storing the 
same meta-data repeatly. 

A method of repeatedly linking the same meta-data 

25 generated by the recording apparatus 2200 to a plurality 
of input image data to generate image data having meta-data 
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will be described next with reference to Figs. 11 and 12. 

Fig. 11 is a schematic view showing an example in 
which the whole meta-data (file name: Cardlnf o . xml ) is 
repeatedly copied and embedded in a plurality of input still 
5 image data (file name: AUT_001.jpg, AUT_002.jpg, 
AUT_003. jpg, . . . . ) 

When image data (file name: AUT_001.jpg) and 
meta-data file (file name: Cardlnf o . xml) which are 
independently present, as shown by (before linking) in 

10 Fig. 11, are linked to each other by the recording apparatus 
2200, the whole information of the meta-data is copied and 
embedded at the end of the image data (file name: 
AUT_001.jpg), as shown by (after linking) in Fig. 11. 

When the meta-data file (file name: Cardlnf o . xml ) is 

15 linked to the second image data (file name: AUT_002.jpg) 
by the recording apparatus 2200 in the same manner as 
described above, the whole information of the meta-data is 
copied and embedded at the end of the image data (file name: 
AUT_002.jpg). Thus, the same meta-data generated by the 

20 recording apparatus 2200 is repeatedly linked to a 
plurality of image data. 

Fig. 12 is a schematic view showing an example in 
which only meta-data information (file name: Cardlnf o . xml ) 
is repeatedly attached to a plurality of input still image 

25 data (file name: AUT_001.jpg, AUT_002.jpg, 
AUT_003 .jpg, . . . . ) 
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When image data (file name: AUT_001.jpg) and 
meta-data file (file name: Cardlnf o . xml ) which are 
independently present, as shown by (before linking) in 
Fig. 12, are linked to each other by the recording apparatus 
5 2200, information representing the meta-data file name 
(Cardlnfo.xml) is attached to the end of the image data, 
as shown by (after linking) in Fig. 12, so the image data 
is linked to the meta-data file (Cardlnfo.xml) that is 
actually present. 

10 When the meta-data file (file name: Cardlnfo.xml) is 

linked to the second image data (file name: AUT_002.jpg) 
by the recording apparatus 2200 in the same manner as 
described above, information representing the meta-data 
file name (Cardlnfo.xml) is attached to the end of the image 

15 data (filename: AUT_002.jpg), as shown by (after linking) 
in Fig. 12, Thus, the same meta-data generated by the 
recording apparatus 2200 is repeatedly linked to a 
plurality of image data. 

In the example shown in Fig. 12, linking processing 

20 of attaching only the file name of meta-data is performed, 
instead of embedding the meta-data itself in the image data . 
In place of the meta-data file name, information 
representing the storage location where the meta-data file 
is stored can be attached to the image data. 

25 [Generation of Image Data Having Meta-Data] 

Processing of linking meta-data to image data to 
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generate image data having meta-data, as described with 
reference to Fig. 11 or 12, and storing the generated image 
data having meta-data, which is performed by the recording 
apparatus 2200, will be described next with reference to 
5 the flow chart shown in Fig. 18. In the example to be 
described below, the same meta-data is attached to all image 
data stored on the memory card 403 at once. 

Instead of using the method to be described below, 
for example, the same meta-data can be attached to a 

10 plurality of selected image data. Different meta-data can 
be attached to a plurality of selected image data, 
respectively. Image data stored in the memory of the 
external device 2107 may be used. 

First, in step S1800, the above-described meta-data 

15 (Cardlnfo. xml) stored in the storage section 2102 is loaded 
to the RAM 2106. Alternatively, the above-described 
meta-data (Cardlnfo . xml ) stored on the memory card 403 is 
loaded to the RAM 2106 from the memory card 403 directly 
connected to the data input/output section 2100 or the 

20 memory card 403 inserted into the external device 2107 
connected through the input terminal . In the above example, 
one meta-data stored on the memory card 403 is read out and 
used. However, a plurality of stored meta-data may be read 
out and used. The meta-data remaining on the memory card 

25 403 is erased after it is loaded to the RAM 2106. 

In step S1801, it is checked whether the loaded 
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meta-data is described by an appropriate XML format. If 
NO in step S1801, the flow advances to step S1806 to display 
an XML error, and the operation is ended. If YES in step 
S1801, the flow advances to step S1802. 
5 In step S1802, image data is loaded from the memory 

card 403 to the RAM 2106 through the data input/output 
section 2100. The image data loaded from the memory card 
is erased from the memory card 403. 

In step S1803, the meta-data is linked to the image 

10 data to generate image data having meta-data. More 

specifically, when an instruction for linking the meta-data 
to the image data is issued (a process selected from the 
two processes described above) , the meta-data is attached 
to the image data to generate image data having meta-data. 

15 For example, image data having meta-data shown in Fig. 10A 
or 10B is generated. 

In step S1804, the generated image data having 
meta-data is stored on the memory card 403 or in the storage 
section 2102. This image data having meta-data may be 

20 stored both on the memory card 403 and in the storage section 
2102. 

In step S1805, it is determined whether unloaded 
image data remains on the memory card 403. If YES in step 
S1805, the flow returns to step S1802 to continuously 
25 perform the above-described processing, thereby generating 
new image data having meta-data shown in Fig. 11 or 12 . For 
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example, in the case shown in Fig. 11, the same meta-data 
is repeatedly attached to a plurality of image data to 
obtain image data having meta-data (file name : AUT_002 . jpg, 
AUT_003 .jpg, . . . . ) 
5 On the other hand, if it is determined in step S1805 

that loading of all image data on the memory card 403 and 
meta-data attachment to each image data are completed, the 
series of operations are terminated. 
/J; As described above, only by generating meta-data once 

^ 10 in advance, the meta-data can be repeatedly attached to a 

plurality of different image data input from the memory card 
403. For this reason, the operation of attaching the 
* a meta-data to image data is facilitated. A plurality of 

31 meta-data may be generated in advance and selected as needed 

Ci 15 such that meta-data of different types are attached to a 

C! plurality of image data. In this embodiment, still image 

data is used as binary data. Instead, voice data or moving 
image data may be used as binary data. 

In step S1802, image data are loaded from the memory 
20 card 403 to the RAM 2106 one by one, and each image data 
which has been loaded is erased from the card 403. Instead, 
all image data may be sequentially loaded from the memory 
card 403 to the RAM 2106, and the image data which have been 
loaded may be erased at once. 
25 In step S1804, the image data having meta-data is 

stored in, e.g., the storage section 2102 or on the memory 
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card 403 inserted into the data input/output section 2100. 
However, the image data having meta-data may be stored on 
the memory card 403 as a first storage medium which stores 
image data before meta-data attachment or another memory 
5 card as a second storage medium. 

The image data having meta-data may be directly 
written in the external device 2107 through the output 
terminal of the recording apparatus 2200 or temporarily 
stored on the memory card 403 or in the storage section 2102 

10 and then written in the external device 2107 through the 
memory card 403 or storage section 2102. 

The external device 2107 and data input/output 
section 2100 can be connected not directly as described 
above but using a -wireless channel. In this case, a 

15 wireless channel interface corresponding to the external 
device 2107 is prepared in the data input/output section 
2100. 

The meta-data may be generated in advance, as 
described above, or meta-data prepared on a memory card in 

2 0 advance may be used . Fig . 13 is a view showing this example . 
In this example, for example, a memory card for travel is 
put on sale, and meta-data for travel which is stored on 
the memory card in advance is used. A memory card in which 
meta-data for moving images, meta-data for voice data, and 

25 meta-data for still images are prepared in advance in 
correspondence with binary data may be used. 
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[Third Embodiment (1)] 

As a first recording apparatus according to the third 
embodiment, a recording apparatus 3200 (see Fig. 20) capable 
of loading meta-data stored in a storage medium or the like, 
5 generating still image data as binary data, and linking the 
loaded meta-data to a plurality of generated binary data 
to generate and output binary data each having meta-data 
will be described. The meta-data is generated by a 
dedicated meta-data generation apparatus 4000 (see Fig. 19) 
10 and supplied to the recording apparatus 3200 through a 
portable storage medium or the like. 

[Hardware Configuration of Meta-Data Generation Apparatus 
and Recording Apparatus] 

Figs. 19 and 20 are block diagrams showing the system 
15 configurations of the meta-data generation apparatus 4000 
and recording apparatus 3200. 

A data input/output section 4100 inputs /output s data 
(binary data or meta-data) . As shown in Fig. 25, a memory 
card 403 such as a PC card or PCMCIA card 4109 is directly 
20 inserted into the slot. As shown in Fig. 25, the memory 
card 403 such as a compact flash 4111 or smart medium 4113 
is inserted into the slot via an adapter 4110 or card adapter 
4112. Instead of the memory card 403, a removable medium 
(not shown) may be used. 
25 The meta-data generation apparatus 4000 is directly 

connected to the recording apparatus 3200 via the input 
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terminal of the data input/output section 4100, such as a 
USB terminal, SCSI terminal, or parallel terminal. In the 
following description, a USB terminal is used as an input 
terminal. Data output from the meta-data generation 
5 apparatus 4000 is directly loaded from the meta-data 

generation apparatus 4000 to the recording apparatus 3200 
through the input terminal, or temporarily stored on the 
memory card 403 and then loaded to the recording apparatus 
3200 through the memory card 403. 

10 Conversely, data processed by the recording 

apparatus 3200 is directly written in the meta-data 
generation apparatus 4000 through the input terminal, or 
temporarily stored on the memory card 403 and then written 
in the meta-data generation apparatus 4000 through the 

15 memory card 403. The recording apparatus 3200 and data 
input/output section 4100 can be connected not directly as 
described above but using a wireless channel. In this case, 
a wireless channel interface is prepared in the data 
input/output section 4100. 

20 Input sections 4101 and 4107 input data or an 

instruction from the user and is comprised of, e.g., a 
keyboard, mouse, remote controller, and the like. The 
storage section 4102 stores data and is formed from, e.g., 
a hard disk. 

25 A display section 4103 displays a GUI or image and 

is constructed by, e.g., a CRT or liquid crystal display. 
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A CPU 4104 controls the entire meta-data generation 
apparatus 4000. A ROM 4105 and RAM 4106 provide to the CPU 
4104 a program, data, and work area necessary for processing 
by the CPU 4104. 
5 Necessary control programs are stored in the storage 

section 4102 or ROM 4105. When the storage section 4102 
stores a control program, it is temporarily loaded to the 
RAM 4106 and then executed. 

Although the system configuration includes various 

10 components in addition to the above components, a detailed 
description thereof will be omitted because they are not 
main components of the present invention. 

Figs. 27A and 27B are views showing the outer 
appearance of the meta-data generation apparatus 4000. 

15 The front surface shown in Fig. 27A has a memory card slot 
as one member of the data input/output section 4100, so data 
can be loaded into the meta-data generation apparatus 4000 
through the memory card 403 inserted into the slot. 

A power switch 4202 powers on/off the meta-data 

20 generation apparatus 4000. An infrared light-receiving 
section 4203 receives a signal from a wireless keyboard 4204 
or remote controller 4205 as one member of the input 
section . 

The rear surface shown in Fig. 27B has a display 
25 output terminal 4306 to which the display section 4103 such 
as a CRT or liquid crystal display is connected. To 
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directly connect the meta-data generation apparatus 4000 
to the recording apparatus 3200, a USB terminal as an input 
terminal 4307 or a member of the data input/output section 
4100 is used. As the input terminal 4307, a SCSI terminal 
5 (not shown) or parallel terminal (not shown) may be prepared 
at an arbitrary position on the front or rear surface of 
the meta-data generation apparatus 4000. 

The recording apparatus 3200 will be described next 
with reference to Fig. 20. 

10 A data input/output section 3100 inputs/outputs data 

(binary data or meta-data) . The structure of a memory card 
slot as one member of the data input/output section 3100 
is the same as that described with reference to Fig. 25, 
and a detailed description thereof will be omitted. 

15 The recording apparatus 3200 is directly connected 

to the meta-data generation apparatus 4000 via an input 
terminal such as a USB terminal, SCSI terminal, or parallel 
terminal as one member of the data input/output section 3100 . 
. In the following description, a USB terminal is used as an 

20 input terminal. 

Data (binary data or meta-data) recorded by the 
meta-data generation apparatus 4000 is directly loaded from 
the meta-data generation apparatus 4000 to the recording 
apparatus 3200 through the input terminal, or temporarily 

25 stored on the memory card 403 and then loaded to the 
recording apparatus 3200 through the memory card 403. 
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Conversely, data processed by the recording apparatus 3200 
is directly written in the meta-data generation apparatus 
4000 through the input terminal, or temporarily stored on 
the memory card 403 and then written in the meta-data 
5 generation apparatus 4000 through the memory card 403. 
Data processed by the recording apparatus 3200 is written 
in a storage section 3102. The meta-data generation 
apparatus 4000 and data input/output section 3100 can be 
connected not directly as described above but using a 
10 wireless channel. In this case, a wireless channel 

interface is prepared in the data input/output section 
3100. 

An input section 3101 inputs data or an instruction 
from the user and is formed from, e.g.; operation buttons, 
15 shutter button, and the like. The storage section 3102 
stores data and is formed from, e.g., a hard disk . A display 
section 3103 displays a GUI or image and is constructed by, 
e.g., a CRT or liquid crystal display. 

A CPU 3104 controls the entire recording apparatus 
20 3200. A ROM 3105 and RAM 3106 provide to the CPU 3104 a 
program, data, and work area necessary for processing by 
the CPU 3104. Necessary control programs are stored in the 
storage section 3102 or ROM 3105. When the storage section 
3102 stores a control program, it is temporarily loaded to 
25 the RAM 3106 and then executed. 

A CCD 3108 converts an optical image obtained by image 
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sensing into an electrical signal, thereby generating image 
data. To convert voice into an electrical signal to 
generate voice data, a microphone (not shown) can be used 
in place of the CCD 3108 . Although the system configuration 
5 includes various components in addition to the above 

components, a detailed description thereof will be omitted 
because they are not main components of the present 
invention. Figs. 28A and 28B are views showing the outer 
appearance of the recording apparatus 3200. The front 
\i\ 10 surface shown in Fig. 28A has an image sensing lens 3201, 
and the upper surface has an image sensing button as a member 
;"=H of the input section 3101. The side surface shown in 

Fig. 28A has a memory card slot as a member of the data input 
pi ' section 3100, so data can be loaded into the recording 

CI 15 apparatus 3200 through the memory card 403 inserted into 
Cj the slot. The side surface also has a USB terminal 3204 

as an input terminal as another member of the data input 
section 3100, through which the meta-data generation 
apparatus 4000 can be connected, thereby enabling exchange 
20 of meta-data or image data. 

The rear surface shown in Fig. 28B has a liquid 
" crystal panel as the display section 3103, so sensed image 
data can be displayed, or a GUI for meta-data attachment 
can be displayed. The rear surface has operation buttons 
25 3206 as members of the input section 3101, which are used 
for adjustment in image sensing, or to input meta-data or 
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attach meta-data to image data. 

In the example shown in Fig. 28A, only the USB 
terminal 3204 is shown as an input terminal. Any other 
input terminal such as a parallel terminal or SCSI terminal 
5 may be used as far as it can transmit /receive data. The 
meta-data generation apparatus 4000 and data input/output 
section 3100 can be connected not directly as described 
above but using a wireless channel. In this case, a 
wireless channel interface corresponding to the meta-data 

10 generation apparatus 4000 is included in the data 
input/output section 3100. 

Fig. 21 is a block diagram showing the functional 
arrangement using the meta-data generation apparatus 4000 
and recording apparatus 3200. The meta-data generation 

15 apparatus 4000 comprises a meta-data generation section 

3401 and recording section 3402. The meta-data generation 
section 3401 generates meta-data. The recording section 

3402 records the meta-data generated by the meta-data 
generation section on a memory card. The operation of the 

20 meta-data generation section 3401 is performed under the 
control of the CPU 4104 which controls the control program 
stored in the ROM 4105 using the work area of the RAM 4106. 
The operation of storing meta-data on the memory card 403 
by the recording section 3402 is performed through the data 

25 input/output section 4100. 

The recording apparatus 3200 comprises a reading 



- 57 - 



# 



section 3404, image data generation section 3405, and 
recording section 3406. The reading section 3404 reads out 
data stored on the memory card 4 03 through the data 
input/output section 4100. The image data generation 
5 section 3405 generates RGB image data from an image signal 
obtained by the CCD 3108 or an image compressed by JPEG or 
the like, as needed. The recording section 3406 links image 
data to meta-data and outputs the data to the memory card 
403 as a first or second recording medium. The operations 
10 of the image data generation section 3405 and recording 
section 3406 are performed under the control of the CPU 3104 
which controls the control program stored in the ROM 3105 
using the work area of the RAM 3106. 

[Generation and Storage of Meta^-Data and Binary Data Having 

15 Meta-Data] 

Generation and storage of meta-data and binary data 
having meta-data using the meta-data generation apparatus 
4000 and recording apparatus 3200 according to the third 
embodiment (1) will be described below in detail. To 

20 generate binary data having meta-data, a method of 

embedding the entire meta-data in binary data or a method 
of embedding only meta-data information (e.g., a file name) 
in binary data is used. These methods will be sequentially 
described below. 

25 Assume that various events of an athletic meeting are 

to be sensed using the recording apparatus 3200. Before 
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image sensing or in preparing for the athletic meeting, the 
user inserts the memory card 403 into the meta-data 
generation apparatus 4000 and records pieces of information 
known in advance, including the name of event to be sensed, 
5 image sensing location, and data and time of image sensing, 
as a meta-data template. 

[Generation and Storage of Meta-Data by Meta-Data 
Generation Apparatus ] 

For example, when pieces of information are known, 

10 including the date "1999, July 14", the user name "Taro", 
the event name "athletic meeting", and the location 
"athletic park", the meta-data generation apparatus 4000 
generates meta-data shown in Fig. 8. 

The meta-data input method and meta-data generation 

15 method using the meta-data generation apparatus 4000 to 
obtain the meta-data shown in Fig. 8 are the same as 
described about the recording apparatus 2200 of the second 
embodiment. That is, the contents are the same as those 
described in detail in paragraphs [Input of Meta-Data] to 

20 [Write of Meta-Data in Storage Section or on Memory Card] 
with reference to Figs. 4 to 7, and a detailed description 
thereof will be omitted. 

The generated XML data shown in Fig. 8 is recorded 
on the root directory of the memory card 403 with a file 

25 name "Cardlnf o . xml " . When this operation is completed, 
the user removes the memory card 403 from the meta-data 
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generation apparatus 4000 and inserts it into the recording 
apparatus 3200. 

[Generation Of Image Data and Image Data Having Meta-Data 
by Recording Apparatus] 
5 At the site of image sensing, i.e., in the athletic 

meeting, the user senses an image using the recording 
apparatus 3200. Note that the memory card 403 which stores 
the meta-data generated by the meta-data generation 
apparatus 4000 is kept inserted into the recording 

10 apparatus 3200. 

In image sensing, when the user presses an image 
sensing button 3202 of the input section 3101, an image 
signal is stored in the CCD 3108, converted into RGB image 
data, and compressed to JPEG data. When compression is 

15 ended, the recording apparatus 3200 reads out the meta-data 
(Cardlnf o . xml ) from the memory card 403 through the data 
input/output section 3100, links the meta-data 
(Cardlnf o . xml ) to the image data to generate image data 
having meta-data shown in Fig. 22 or 10B, and writes the 

20 generated image data having meta-data on the memory card 
403 or the like. Thus, image data having meta-data is 
generated and stored on the memory card 403 or the like. 

Processing of linking the meta-data to the image data 
obtained by image sensing to generate image data having 

25 meta-data and storing the generated image data having 

meta-data on the memory card 403 by the recording apparatus 
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3200 will be described next in detail with reference to 
Fig. 26 and Figs. 10A to 12. 

As the method of generating image data having 
meta-data using the recording apparatus 3200, 1) the first 
5 method of embedding all the meta-data in still image data 
or 2) the second process of attaching only meta-data 
information to still image data can be used. These two 
methods are the same as those described about the recording 
apparatus 200 of the first embodiment. That is, the 

10 contents are the same as those described in detail in 

paragraphs [Processing of Linking Meta-Data to A Plurality 
of Binary Data] with reference to Figs. 10A to 12, and a 
detailed description thereof will be omitted. 
[Processing of Storing Generated Image Data Having 

15 Meta-Data] 

Processing of linking meta-data to image data to 
generate image data having meta-data, as described with 
reference to Figs. 11 and 12, and storing the generated 
image data having meta-data by the recording apparatus 3200 

20 will be described next with reference to the flow chart 
shown in Fig. 26. In the example to be described below, 
the same meta-data is repeatedly attached to each image data 
generated by image sensing. 

Instead of using the method to be described below, 

25 for example, a plurality of meta-data can be prepared in 
advance in correspondence with a plurality of image data 
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to be sensed, and the different meta-data can be selected 
and repeatedly attached to the image data, respectively. 

First, in step S2801, the image data generated 
through the CCD 3108 is loaded to the RAM 3106. 



(Cardlnfo.xml) stored on the memory card 403 is loaded to 
the RAM 106 through the data input/output section 4100. In 
the above example, one meta-data stored on the memory card 
403 is read out and used. However, a plurality of stored 

10 meta-data may be read out and used. 

In step S2803, it is checked whether the loaded 
meta-data is described by an appropriate XML format. If 
NO in step S2803, the flow advances to step S2805 to display 
an XML error, and the operation is ended. If YES in step 

15 S2803, the flow advances to step S2804. To determine the 
appropriate format, it is checked whether the description 
format of an XML file is satisfied (e.g., whether a tag 
has a correct pair of left and right angle brackets, or the 
tag format is correct) . Determining whether or not the XML 

20 data has an appropriate format may include checking whether 
or not the XML data is valid. Whether or not the XML data 
is valid is determined by checking, e.g., whether or not 
the XML data is described in accordance with the schema of 
DTD (Document Type Definition) . 

25 In step S2804, the meta-data is linked to the image 

data to generate image data having meta-data. More 



5 



In step S2802, the above-described meta-data 
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specifically, when an instruction for linking the meta-data 
to the image data is issued, the meta-data is attached to 
the image data to generate image data having meta-data. 
That is, image data having meta-data shown in Fig. 10A or 
5 10B is generated. 

In step S2805, the generated image data having 
meta-data is stored on the memory card 403, and the 
operation is ended. This image data having meta-data may 
be stored in the storage section 4102 or both on the memory 

10 card 403 and in the storage section 3102. 

If the user wants to continue image sensing, the 
above-described series of operations are repeatedly 
performed from the beginning, thereby generating new image 
data having meta-data shown in Fig. 11 or 12. For'example, 

15 in the case shown in Fig. 11, the same meta-data is 

repeatedly attached to a plurality of image data to obtain 
image data having meta-data (file name: AUT_002.jpg, 
AUT_003. jpg, . . . . ) 

As described above, only by generating meta-data once 

20 in advance, the meta-data can be repeatedly attached to 
image data obtained by image sensing to generate image data 
having meta-data. For this reason, operation of 
generating the image data having meta-data is facilitated. 
The generated meta-data can also be repeatedly attached to 

25 even a plurality of different image data not obtained by 
image sensing but input from the memory card 403 to generate 
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image data having meta-data. 

A plurality of meta-data may be generated in advance 
and selected as needed such that meta-data of different 
types are attached to a plurality of image data. In this 
5 embodiment, still image data is used as binary data. 

Instead, voice data or moving image data may be used as 
binary data. 

In step S2804, the image data having meta-data is 
stored in, e.g., the storage section 3102 or on the memory 

10 card 403 inserted into the data input/output section 3100. 
However, the image data having meta-data may be stored on 
the memory card 403 as a first storage medium which stores 
image data before meta-data attachment or another memory 
card as a second storage medium. 

15 The image data having meta-data may be directly 

written in the meta-data generation apparatus 4000 through 
the input terminal of the recording apparatus 3200 or 
temporarily stored on the memory card 403 or in the storage 
section 3102 and then written in the meta-data generation 

20 apparatus 4000 through the memory card 403 or storage 
section 3102. 

The meta-data generation apparatus 4000 and data 
input/output section 3100 can be connected not directly as 
described above but using a wireless channel . In this case, 

25 a wireless channel interface corresponding to the meta-data 
generation apparatus 4000 is included in the data 



- 64 - 



input/output section 3100. 

The meta-data may be generated in advance, as 
described above, or meta-data prepared on a memory card in 
advance may be used. Fig. 13 is a view showing this example, 
5 In this example, for example, a memory card for travel is 
put on sale, and meta-data for travel which is stored on 
the memory card in advance is used. A memory card in which 
meta-data for moving images, meta-data for voice data, and 
meta-data for still images are prepared in advance in 

10 correspondence with binary data may be used. 

As described above, when information that is known 
about image data is prepared as a meta-data template in 
advance, and meta-data is repeatedly attached to image data 
in image sensing, the time required to attach meta-data to 

15 the image data can be shortened. In this embodiment, the 
meta-data generation apparatus 4000 and the recording 
apparatus 3200 must easily exchange data . For this purpose, 
it is suitable to use a detachable recording medium between 
the meta-data generation apparatus 4000 and the recording 

20 apparatus 3200. Since a general digital camera can mount 
only one memory card, it is suitable to record both 
meta-data and image data on a single memory card. When 
image data is transferred upon embedding meta-data in the 
image data, the meta-data can always be transferred 

25 together with the image data. 
[Third Embodiment (2)] 
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As a recording apparatus according to the third 
embodiment (2), a recording apparatus 5200 (see Fig. 23) 
capable of loading meta-data stored in a storage medium or 
the like, generating moving image data as binary data, and 
5 linking the loaded meta-data to a plurality of generated 
binary data to generate and output binary data each having 
meta-data will be described. The meta-data is generated 
by the above-described meta-data generation apparatus 4000, 
and the generated meta-data is supplied to the recording 
10 apparatus 5200 through a portable storage medium or the 
like . 

[Hardware Configuration of Meta-Data Generation Apparatus 
and Recording Apparatus] 

The third embodiment (2) uses the meta-data 

15 generation apparatus 4000 shown in Fig. 19 and the 

recording apparatus 5200 shown in Fig. 23. The meta-data 
generation apparatus 4000 for generating meta-data is the 
same as that described in the third embodiment (1), and a 
detailed description of its hardware configuration will be 

20 omitted. 

Referring to Fig. 23, a data input/output section 
5100 inputs/outputs data (binary data or meta-data) . A 
memory card 5403 and the structure of a memory card slot 
as one member of the data input/output section 5100 are the 
25 same as those described with reference to Fig. 25, and a 
detailed description thereof will be omitted. 
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The recording apparatus 5200 is directly connected 
to the meta-data generation apparatus 4000 via an input 
terminal such as a USB terminal, SCSI terminal, or parallel 
terminal as one member of the data input/output section 5100 . 
5 In the following description, a USB terminal is used as an 
input terminal. Data (binary data or meta-data) recorded 
by the meta-data generation apparatus 4000 is directly 
loaded from the meta-data generation apparatus 4000 to the 
recording apparatus 5200 through the input terminal, or 

10 temporarily stored on the memory card 5403 and then loaded 
to the recording apparatus 52 00 through the memory card 54 03 . 
Conversely, data processed by the recording apparatus 5200 
is directly written in the meta-data generation apparatus 
4000 through the input terminal, or temporarily stored on 

15 the memory card 5403 and then written in the meta-data 
generation apparatus 4000 through the memory card 5403. 
Data processed by the recording apparatus 5200 is written 
in a storage section 5102. The meta-data generation 
apparatus 4000 and data input/output section 5100 can be 

20 connected not directly as described above but using a 
wireless channel. In this case, a wireless channel 
interface is prepared in the data input/output section 
5100. 

An input section 5101 inputs data or instructions 
25 from the user and is formed from, e.g., operation buttons 
and the like. The storage section 5102 stores data and is 
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formed from, e.g., a hard disk. A display section 5103 
displays a GUI or image and is constructed by, e.g., a CRT 
or liquid crystal display. 

A CPU 5104 controls the entire recording apparatus 
5 5200. A ROM 5105 and RAM 5106 provide to the CPU 5104 a 
program, data, and work area necessary for processing by 
the CPU 5104 . Necessary control programs are stored in the 
storage section 5102 or ROM 5105. When the storage section 
5102 stores a control program, it is temporarily loaded to 

10 the RAM 5106 and then executed. A CCD 5108 converts an 
optical image obtained by image sensing into an electrical 
signal, thereby generating image data. A tape drive 5107 
stores moving image data. 

Fig. 24 is a block diagram showing the functional 

15 arrangement using the meta-data generation apparatus 4000 
and recording apparatus 5200. The meta-data generation 
apparatus 4000 comprises a meta-data generation section 
5401 and recording section 5402. The meta-data generation 
section 5401 generates meta-data such as a title and 

20 personal identification information. The recording 
section 5402 records the meta-data generated by the 
meta-data generation section on a memory card. The 
operation of the meta-data generation section is performed 
under the control of the CPU 5104 which controls the control 

25 program stored in the ROM 5105 using the work area of the 
RAM 5106. The operation of storing meta-data on the memory 
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card 5403 by the recording section 5402 is performed through 
the data input/output section 5100. 

The recording apparatus 5200 comprises a reading 
section 5404, image data generation section 5405, and 
5 recording section 5406. The reading section 5404 reads out 
data stored on the memory card through the data input/output 
section 4100. The image data generation section 5405 
generates RGB image data from an image signal obtained by 
the CCD 3108 or an image compressed by Motion- JPEG or the 

10 like, as needed. The recording section 5406 links image 
data to meta-data and outputs the data to the tape. The 
operations of the image data generation section 5405 and 
recording section 5406 are performed under the control of 
the CPU 4104 which controls the control program stored in 

15 the ROM 4105 using the work area of the RAM 4106. 

[Generation and Storage of Meta-Data and Binary Data Having 
Meta-Data] 

Generation and storage of meta-data and binary data 
having meta-data using the meta-data generation apparatus 

20 4000 and recording apparatus 5200 according to the third 
embodiment (2) will be described below in detail. To 
generate binary data having meta-data, a method of 
embedding the whole meta-data in binary data or a method 
of embedding only meta-data information (e.g., a file name) 

25 in binary data is used. These methods will be sequentially 
described below. 
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Assume that various events of an athletic meeting are 
to be sensed using the recording apparatus 5200. Before 
image sensing or in preparing for the athletic meeting, the 
user inserts the memory card 5403 into the meta-data 
5 generation apparatus 4000 and records pieces of information 
known in advance, including the name of event to be sensed, 
image sensing location, and data and time of image sensing, 
as a meta-data template . 

[Generation and Storage of Meta-Data by Meta-Data 

10 Generation Apparatus] 

For example, when pieces of information are known, 
including the date "1999, July 14", the user name "Taro", 
the event name "athletic meeting", and the location 
"athletic park", the meta-data generation apparatus 4000 

15 generates meta-data shown in Fig. 8. 

The meta-data input method and meta-data generation 
method using the meta-data generation apparatus 4000 to 
obtain the meta-data shown in Fig. 8 are the same as 
described about the recording apparatus 2200 of the second 

20 embodiment. That is, the contents are the same as those 
described in detail in paragraphs [Input of Meta-Data] to 
[Write of Meta-Data in Storage Section or on Memory Card] 
with reference to Figs. 4 to 7, and a detailed description 
thereof will be omitted. 

25 The generated XML data shown in Fig. 8 is recorded 

on the root directory of the memory card 5403 with a file 
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name "Cardlnf o . xml" . When this operation is ended, ■ the 
user removes the memory card 5403 from the meta-data 
generation apparatus 4000 and inserts it into the recording 
apparatus 5200. 

5 [Generation Of Image Data and Image Data Having Meta-Data 
by Recording Apparatus] 

At the site of image sensing, i.e., at the athletic 
meeting, the user senses an image using the recording 
apparatus 5200 . Note that the memory card 5403 which stores 
10 the meta-data generated by the meta-data generation 
apparatus 4000 is kept inserted into the recording 
apparatus 5200. 

In image sensing, when the user presses the image 
sensing button of the input section 5101, an image signal 
15 is stored in the CCD 5108, converted into RGB image data, 
compressed to JPEG data, and recorded no a tape device. At 
this time, a pointer to "Cardlnf o . xml" is recorded in the 
DV format. 

When compression is ended, the recording apparatus 
20 5200 reads out the meta-data (Cardlnf o . xml ) from the memory 
card 5403 through the data input/output section 5100, links 
the meta-'data (Cardlnf o . xml ) to the image data to generate 
image data having meta-data shown in Fig. 22 or 10B, and 
writes the generated image data having meta-data on the 
25 memory card 5403 or the like. Thus, image data having 
meta-data is generated and stored on the memory card 5403 
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or the like . As described above, even for moving image data, 
when information known in advance is prepared as a meta-data 
template and repeatedly attached to the moving image data 
in image sensing, moving image data having meta-data can 
5 be easily generated. 

Processing of linking the meta-data to the image data 
obtained by image sensing to generate image data having 
meta-data and storing the generated image data having 
meta-data on the memory card 5403 by the recording apparatus 

10 5200 will be described next in detail with reference to 
Fig. 26 and Figs. 10A to 12. As the method of generating 
image data having meta-data using the recording apparatus 
5200, 1) the first method of embedding the entire meta-data 
in moving image data or 2) the second process of attaching 

15 only meta-data information to moving image data can be used . 

These two methods are the same as those described 
about the recording apparatus 3200 of the third embodiment 
(1) . That is, the contents are the same as those described 
in detail in paragraphs [Processing of Linking Meta-Data 

20 to A Plurality of Binary Data] to [Processing of Storing 
Generated Image Data Having Meta-Data] with reference to 
Figs. 10A to 12 and Fig. 26, and a detailed description 
thereof will be omitted. 

As described above, according to the third embodiment 

25 (1) and third embodiment (2), the meta-data generation 
apparatus 4000 dedicated to generate meta-data is separated 
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from the recording apparatus 3200 or 5200 for sensing binary 
data and generating and storing image data having meta-data, 
thereby further facilitating meta-data generation. 

[Other Embodiment] 

The present invention may be applied to a system 
constituted by a plurality of devices (e.g., a host computer, 
an interface device, a reader, a printer, and the like) or 
an apparatus comprising a single device (e.g., a copying 
machine, a facsimile apparatus, or the like) . The object 
of the present invention is realized even by supplying a 
storage medium (or recording medium) storing software 
program codes for realizing the functions of the 
above-described embodiments to a system or apparatus, and 
causing- the computer (or a CPU or an MPU) of the system or 
apparatus to read out and execute the program codes stored 
in the storage medium. In this case, the program codes read 
out from the storage medium realize the functions of the 
above-described embodiments by themselves, and the storage 
medium storing the program codes constitutes the present 
invention. The functions of the above-described 
embodiments are realized not only when the readout program 
codes are executed by the computer but also when the OS 
(Operating System) running on the computer performs part or 
all of actual processing on the basis of the instructions 
of the program codes. 

The functions of the above-described embodiments are 




also realized when the program codes read out from the storage 
medium are written in the memory of a function expansion board 
inserted into the computer or a function expansion unit 
connected to the computer, and the CPU of the function 
5 expansion board or function expansion unit performs part or 
all of actual processing on the basis of the instructions 
of the program codes. 

When the present invention is applied to the storage 
medium, it stores program codes corresponding to the flow 

10 charts described in the above embodiments. 

As many apparently widely different embodiments of the 
present invention can be made without departing from the 
spirit and scope thereof, it is to be understood that the 
invention is not limited to the specific embodiments thereof 

15 except as defined in the appended claims. 
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